GEOMETRIC QUANTIZATION FOR PROPER ACTIONS 



VARGHESE MATHAI AND WEIPING ZHANG 
(WITH AN APPENDIX BY ULRICH BUNKE) 



Abstract. We first introduce an invariant index for G-equivariant elliptic 
differential operators on a locally compact manifold M admitting a proper 
cocompact action of a locally compact group G. It generalizes the Kawasaki 
index for orbifolds to the case of proper cocompact actions. Our invariant 
index is used to show that an analog of the Guillemin-Sternberg geometric 
quantization conjecture holds if M is symplectic with a Hamiltonian action of 
G that is proper and cocompact. This essentially solves a conjecture of Hochs 
and Landsman. 



1. Introduction 

The main purpose of this paper is to generalize the Guillemin-Sternberg geomet- 
ric quantization conjecture [5], which was proved in |12j . to the case of noncompact 
spaces and group actions. Here we will consider the framework considered by Hochs 
and Landsman in [9]. 

To be more precise, let (M, ui) be a locally compact symplectic manifold. Assume 
that there exists a Hermitian line bundle (L, h L ) over X carrying a Hermitian 
connection V L such that 2^(V 1 ') 2 = w. Let J be an almost complex structure 
on TM such that w(-,J-) defines a Riemannian metric g™ on TM. Let D L : 
fi 0, *(M, L) — > f2°'*(M, L) be the canonically associated Spin c -Dirac operator (cf. 
[TBI Section 1]). Let D± be the restrictions of D L on f2 0, ^aa~ (M, L) respectively. 

Let G be a locally compact group with Lie algebra g. Suppose that G acts on 
M properly. The proper G-action ensures that the isotropy subgroups G x = {g e 
G\gx = x} are compact subgroups of G for all x g M, all the orbits Gx — {gx\g € 
G} Q M are closed, and moreover the space of orbits M/G is Hausdorff (cf. [P3]V 

We assume that the action of G on M lifts on L. Moreover, we assume the 
G-action preserves the above metrics and connections on TM,L, and J. Then 
commute with the G-action. 

The action of G on L induces naturally a moment map : M — > g* such that 
for any V € Q, s € L(L), if Vm denotes the induced Killing vector field on M, then 
the following Kostant formula for Lie derivative holds, 



(1.1) L Vm s = V£ M s - 2tt^T( m , V) 



s. 



Vm' 

We make the assumption that € 0* is a regular value of \i and that G 
acts freely on /i _1 (0). Then the Marsden-Weinstein symplectic reduction (Mq = 



2000 Mathematics Subject Classification. Primary 58F06, Secondary 53D50, 53D20, 53C27, 
58J20, 58G10. 

Key words and phrases. Geometric quantization, locally compact groups, Hochs-Landsman 
conjecture, Guillemin-Sternberg conjecture, equivariant K-theory, index theorem for generalized 
orbifolds. 

1 



2 VARGHESE MATHAI AND WEIPING ZHANG (WITH AN APPENDIX BY ULRICH BUNKE) 



H 1 (0)/G, ujm g ) is a symplectic manifold. Moreover, (L, V L ) descends to {Lq, V Lg ) 
over Xq so that the corresponding curvature condition ^^^-R Lg — ^>g holds. The 
G-invariant almost complex structure J also descends to an almost complex struc- 
ture on TMg, and h L , g™ descend to h La , g™ G respectively. Let D Lg denote 
the corresponding Spin c -Dirac operator on Mq, 

Following 9 ], we make the assumption that the quotient space M/G is compact, 
that is, the G-action on M is cocompact. Then Mq = /i _1 (0)/G is also compact. 

In this paper, we will first define in Section [2] what we call the G-invariant index 
associated to D+, denoted by indG , (-D+), which generalizes the usual definition in 
the compact case to the non-compact case. 

For any positive integer p, let L p denote the p-th tensor power of L. Then 
it admits the canonically induced G-action as well as the G-invariant Hermitian 
metric and connection. 

We can now state the main result of this paper, which might be thought of as 
a "quantization commutes with reduction" result, in the sense of a conjecture of 
Hochs and Landsman [9l Conjecture 1.1], as follows. 

Theorem 1.1. In the general case where G is merely assumed to be locally compact, 
there exists po > such that for any integer p > po, 

(1.2) ind G (pf ) - ind (D+ G ) . 

Moreover, if g* admits an Ada-invariant metric, then one can take p — 1 in il.ty) . 

Remark 1.2. In the special case where G (and thus M) are compact, Theorem 
11.11 is the Guillemin-Sternberg geometric quantization conjecture [5] first proved 
by Meinrenken in [12] (See the excellent survey of Vergne [18] for further related 
works). In the special case where G is noncompact and admits a normal discrete 
subgroup r such that V acts on M freely and that G/T is compact^ Theorem 1 1.1 1 is 
closely related to Theorem 1.2]. While in the special case where G is semisimple 
and acts on G x k N, with K the maximal compact subgroup of G acting Hamilto- 
nianly on a compact symplectic manifold N, Theorem 11.11 should be closely related 
to the quantization formula of Hochs obtained in [7]. In fact, in the formulas of 
Hochs and Hochs-Landsman, the left hand side of the quantization formula is inter- 
preted by using noncommutative /^-theories. Thus, in combining with our result, 
in the case considered by them, our invariant index admits the noncommutative K- 
theoretic interpretation. In fact, in the Appendix to this paper, Bunke establishes 
such an interpretation. Combining with Kasparov's index theorem |10j . one gets a 
topological counterpart to our analytic index. 

Since here one is dealing with noncompact group actions on noncompact spaces, 
one can not apply the Atiyah-Bott-Segal-Singer equivariant index theorem directly 
as in [T2] to prove Theorem ll.il Instead, we will generalize the analytic proof of the 
Guillemin-Sternberg conjecture due to Tian and Zhang [16] to the current situation. 

On the other hand, one can show that the finiteness of dim(Ker D±) G , the di- 
mensions of the G-invariant subspaces of Ker(D±), holds for any equivariant Dirac 
type operator on spaces with proper cocompact actions. Moreover, we will show 
that the vanishing properties of the half kernel of Spin c -Dirac operators due to 
Braverman [J, Borthwick-Uribe [2] and Ma-Marinescu [TT| still hold for D L when 
p > is large. Combining with Theorem ll.il one gets 



In this case there is an A&q invariant metric on g* . 
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Theorem 1.3. There exists p\ > such that for any integer p > p\, one has 
(1.3) dim (Ker D f \ ° = dim (Ker D+ G \ , 

dim (KerD^Y = dim (KerD^ = 0. 

Remark 1.4. Just as in [16], one can twist L p by an arbitrary G-equivariant 
vector bundle F over M carrying a G-invariant Hcrmitian metric and a G-invariant 
Hermitian connection (that is, replace LP by LP <Ei F). Then all the results of 
this paper still hold when p > is large enough. In particular, if we chose F = 
A*'°(T*M), then we get a non-compact quantization formula for the signature 
quantization considered in |17j and [6]. 

Remark 1.5. Our method also works for the case where the action of G on /i _1 (0) 
is not free. Then M G = ^- 1 (0)/G is an orbifold, and (|1.2[) and (| 1 . 3[) still hold if 
we replace the righthand sides by the corresponding orbifold indices. We leave this 
to the interested reader. 

The rest of this paper is organized as follows. In <J21 for any locally compact 
manifold M admitting a proper cocompact action of a locally compact group G, 
and any G-equivariant Dirac type operator D on M, we introduce what we call the 
G-invariant index indc(-D). In ££3j we generalize the analytic techniques developed 
in |16j to give a proof of Theorem 11.11 In Sj4[ we prove the vanishing properties 
of the G-invariant part of the half kernel of the equivariant Dirac operator and as 
a consequence, get Theorem 11.31 Finally, in §5, we consider some examples and 
applications of our main results. 

2. The invariant index for proper cocompact actions 

Let M be a locally compact manifold. Let G be a locally compact group. Let 
dg be the left invariant Haar measure on G. 

We make the assumption that G acts on M properly and cocompactly, where by 
proper action we mean that the following map 

(2.1) G x M -> M x M, (g, x) ^ (x, gx) 

is proper (that is, the inverse image of a compact subset is compact), while by 
cocompact we mean that the quotient M/G is a compact space. 

One of the basic properties for such an action is that there exists a smooth, 
non-negative, compactly supported cut-off function c on M such that 

(2.2) f c(g- x xfdg=l 

JG 

for any x £ M (cf. [31 Section 7.2.4, Proposition 8]). This cut-off function allows 
one to get G-invariant objects from the originally not necessarily G-invariant ones. 

As an example, for any Riemannian metric g™ on TM one gets an "averaged" 
G-invariant metric 

(2.3) / c(h- 1 x) 2 {h*g™){x)dh 

JG 

on TM. 

From now on, we assume that g™ is G-invariant. 
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Let cl(TM) be the Clifford algebra bundle associated to (TM, g™). Then it 
admits a naturally induced G-action as well as a G-invariant Hermitian metric 

g cl(TM)_ 

Let E be a complex vector bundle over M such that E — E + _E_ is a Z2- 
graded cl(TM)-module and that it admits a G-action, preserving the Z2-grading of 
E, lifted from the action of G on M. Let g B be a Z2-graded G-invariant Hermitian 
metric on E, let V s be a Z2-graded G-invariant Hermitian connection on E. The 
averaging procedure similar to that in (|2.3I) guarantees the existence of g E and V £ . 

Let ei, • • • , edim m be an oriented orthonormal basis of TM . We define a Dirac 
type operator D E to be the operator acting on T(E), 

dim M 

(2.4) D E = c{e t )\/ E +A:T(E)^T(E), 

t=l 

where A g L(End(i?)) exchanges i£±. 

We make the assumption that D E is G-equivariant. 

Let T(E) carry the natural inner product such that for any s, s' £ with 
compact supports, 

(2.5) (s,s') = f (s(x),s'(x)) E dx. 

Let || • || denote the associated L 2 -norm. Let L 2 (M,E) denote the completion of 
T(E) with respect to the inner product || • 1 1 - 

Since M/G is compact, there exists a compact subset Y of M such that G(Y) = 
M (cf. [U Lemma 2.3]). 

Let U, U' be two open subsets of M such that Y C U and that the closures U 
and U' are both compact in M, and that U C U'. The existence of U, U' is clear. 

Then it is easy to construct a smooth function / : M — > [0, 1] such that f\u = 1 
and Supp(/) C U'. 

We now consider the space T(E) G , the subspace of G-invariant sections of T(E). 

By using the property that G(Y) — M, it is easy to see that there exists a 
positive constant G > such that for any s £ T(E) G , 

(2-6) Nko< IIMIo< \\s\\w,o<C\\s\\ Ufi , 

where for V = U or U', 

(2.7) P|| 2 y , - / (s(x),s(x)) E dx. 

Jv 

Let Hy (M, E) be the completion of the space {fs : s £ T(E) G } under the norm 
|| • || associated to the inner product (|2.5[) . Let Hi(M, E) G be the completion of 
{fs : s £ T(E) G } under a (fixed) G-invariant first Sobolev norm associated to the 
inner product (|2.5j) . 

Let Pf be the orthogonal projection from L 2 (M,E) to its subspace H°(M, E) G . 
It is clear that PfD E maps an element of Hj-(Af, _E) G into H^(M,^) G . 

Proposition 2.1. TTie induced operator 

(2.8) PfD E : H}(M, £;) G -> H^(M, £;) G 



2 With this function, one can construct the cut-off function c by c(x) = — ; — tto for 

any x € M. 
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is a Fredholm operator. 

Proof. For any s G T(E) G , by (|2~1) . one has 

(2.9) D E (fs)=fD E S + c(df)s, 

where we identify the one form df with its metric dual {df)*. 

Since D E is G-equi variant, it is clear that Pf{fD E s) — fD E s, while in view of 
(EH), 

(2-10) \\Pf(c(df)s)\\ < || C (d/) S || <C 1 || S || t/ ,o 

for some constant C\ > 0. 

Thus, one has, by also proceeding as in (12.61) . 

(2.11) \\P f D E (.fs)\\ > \\fD E s \\ - Ci||s|| a ,o > C 2 \\s\\ UA - C 3 \\s\\ Ut0 

for some constants G2, C3 > 0. 

On the other hand, by (|2.9[) and by proceeding as in (|2.6p . one verihes that 

(2.12) H/sIIj < G 4 (||/s||o + \\D E (fs)\\ ) < C 5 |Mko + C 6 \\ S \\ UA . 

for some constants G4, G5, C*6 > 0. 

From (HU), (PHI and (|2TT^)) . one gets 

(2-13) \\P f D E (f s )\\ > C 7 \\f S \U - C 8 \\fs\\ , 

for some constants C7, C% > 0. 

Since / is of compact support, from the Garding type inequality (|2.13p one sees 
that PfD E is a Fredholm operator. Q.E.D. 

Remark 2.2. Besides the Fredholm property in Proposition 12.11 the following 
self-adjoint property also holds: for any s, s' € T(E) G , one has 

(2-14) (PfD E (fs), fs') - {fa, P f D E (fs')) , 

if D E is formally self-adjoint. 

Remark 2.3. If (U, U' , f) is another triple of open subsets and the cut-off function 
as above, then by taking the deformation f t = (1 — t)f + tf, one gets easily a 
continuous family of Fredholm operators Pf t D E . 

Now let D E : T(E±) T(E T ) be the restrictions of D E on T(E±) respectively. 

Then by PropositionOand (|2~iH) . the induced operator PfDf : Hi(M, E + ) G ->■ 
H°j:(M, E^) G is Fredholm. Moreover its index, ind(PfD E ), does not depend of the 
choice of /, in view of Remark 12.31 Similarly, it is also easy to see that this index 
does not depend on the choices of G-invariant metrics and connections involved. 

Definition 2.4. We call in^PfDf) defined above the G-invariant index associated 
to D E and denote it by indG(D E ). 

Remark 2.5. If M is compact and D E is formally self-adjoint, then one can take 
/ = 1, so that one has 

(2.15) ind G (Df) = dim ((ker£>f ) G ) - dim ((kcrZ? s ) G ) . 
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Remark 2.6. For any s £ T(E) G , it is clear that fs and s are determined by each 
other. That is, if s, s' £ T(E) G are such that fs — fs', then s — s' as / = 1 on 
Y . Moreover, by (|2.9I) . (|2.10p and (12 . 13[) . one sees easily that the induced operator 
Df : H}(M,£) G -> H°(M,£) G such that 

(2.16) Df(fs) := fD E (s) 
is a Fredholm operator. Thus one gets that 

(2.17) dim (ker ^D E \ r(E)G ^ = dim ((ker£> s ) G ) < +oo. 

In fact, when G is unimodular, we can further identify indG(D^) as follows. 
Theorem 2.7. If G is unimodular, then with the notation above, one has 

(2.18) ind (PfDf) = dim ((kcrZ^) G ) - dim ((ker L^) 
whenever D E is formally self-adjoint. 

Proof. We use the cut-off function /, and set for any x £ M, 



(2.19) c(x) 



1/2' 

fig^xfdg' 



Then 

,-l™\2 



(2.20) / c(g- L xYdg = 1 

for any x £ M. Let a denote the positive G-invariant function on M defined by 

1/2 

(2.21) a{x)=[^jj{g- 1 x) 2 dg 

Let H°(M, £) G be the L 2 completion of the space {cs : s £ T(E) G }. Let 
Hl(AI,E) G be the corresponding first Sobolev space associated to a (fixed) G- 
invariant first Sobolev norm. 

Let fjf : H° f (M,E) G -> H°(M, £) G be the isomorphism such that for any s £ 
T(E) G , 

(2.22) /3/ : /s i — ► /- = cs. 

a 

Let P c be the orthogonal projection from L 2 (M,E) onto U"(M,E) G . 
For any s € T(E) G , one verifies that 

(2.23) 

0/ (P f D E (fs)) = cD E s + ~P f (c(df)s) = P c D E (cs) - P c (c(dc)s) + ^P f (c(df)s). 

Since PfD E is Fredholm, from (|2.23j) . one sees easily that P C D E is a Fredholm 
operator and 

(2.24) ind (P f D E ) = ind (P C D E ) . 

Indeed, what Bunke does in his Appendix is to give a isTif-theoretic interpreta- 
tion of the right hand side of (|2.24p . 

Moreover, Bunke actually writes out explicitly the projection P c when G is uni- 
modular. According to Bunke, when G is unimodular, for any jj, £ T(_E) with 
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compact support, one has (cf. Appendix D, where P c here is exactly Q e there with 
e=l) 

(2.25) (P cM ) (x) = c(x) f cig^x) («?» (x)dg. 

JG 

From (|2.20|) and (|2.25f) . one computes that for any s € T(E) G , one has at x € M 
that 

(2.26) 

P c (c(dc)s) = cj^c{g~ 1 x) (g*(c(dc)sj) (x)dg = ~c • c (d J cig^xfdg) s(x) = 0. 

From (|2.26p . one gets that for any s e r(£) G , 

(2.27) P c D E (cs) = cD E s + P c (c(dc)s) = cD E s. 

When D E is formally self-adjoint, from ()2.27|) one gets immediately that 

(2.28) dim (KerP c L>f ) = dim ((Ker D E ) G ) . 
Combining with (I2.24p . one gets 

(2.29) ind G (D E ) = ind (P C D E ) = dim ((ker £>+) G ) - dim ((ker D E ) G 
which is exactly ([2~T8]) . Q.E.D. 



Remark 2.8. Remark 12.51 and Theorem 12.71 fully justify the term "G-invariant 
index" in Dehnition 12.41 Moreover, by (|2.28[) . one sees that kei(P c D E ) consists of 
smooth elements. 

Remark 2.9. When G is non-unimodular, Theorem 12.71 still holds if one inserts 
the modular factor S (with dg~ x = S(g)dg) in the right hand side of (|2.18p as in 
Bunke's Appendix. We leave it to the interested reader. 

We now consider the very special case where G acts on M freely, but we no 
longer assume that G is unimordular (thus we no longer have Theorem 12. 7p . Then 
M/G is a compact manifold, while E descends to a Hermitian vector bundle Eg 
over M/G carrying an induced Hermitian connection. 

Let D Eg : T(E + ,g) —> T(£ , _ i g) be associated Dirac operator. 

Proposition 2.10. The following identity holds. 
(2.30) ind G (Df) = ind (d Eg ' 

Proof. For any s e T(E G ), let s€ T(E) G be its canonical lift. 
It is clear that the map T(E G ) -> {/r(£:) G } such that s -> fs extends canoni- 



cally to a bounded linear isomorphism ctf : L 2 [Eq) ~ > H<(M, E) G 



Lemma 2.11. There exists a constant C > such that for any s £ T(Eg), one 
has 



(2.31) (a f )- 1 P f D E a f (s)~D E - S < C\\s\ 
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Proof. From (|2.9|) . one has 

(2.32) D E a f s = D E {fZ) = fD E s + c(df)s. 

Now, on the principal fibre bundle G — > M — > M/G, the vertical directions are 
generated by elements in the Lie algebra g. Thus, for any X £ T v M such that 
\X\ = 1, since s is G- invariant so that L E s = 0, where L E is the Lie derivative 
along X on E, one has 

(2.33) ||/ (Vf S)|| - ||/(Vfa-ifS)|| <Ci||/S|| 

for a (fixed) positive constant C\ > 0. 
From (|2.33l) . one verifies easily that 



(2.34) 



(a f )- 1 (fD E t)-D E - t 



<C2\\S\\ 



for a (fixed) positive constant G2 > 0. 
From (|2.34|) . one sees immediately that 



(2.35) 



{a f )- x {P f {SD E 8))-D^8 <C 2 \\s\\ 



On the other hand, one finds easily that there are positive constants G3 > 0, 
C4 > 0, C 5 > such that 



(2.36) 



(ajy 1 P f (c(d/)5) < C 3 \\c(df)s\\ < C 4 < C7 6 || S | 



From (p32|) . ([235]) and (f2~36| . one gets (f23T|) . Q.E.D. 



We now return to the proof of (|2.30l) . 

By restricting (|2.31[) to T(E + ^g), one deduces that 

(2.37) ind = ind ((a/)" 1 P/Z^a/) = ind (P f D E ) , 

which is exactly (|2~30l> . Q.E.D. 

Remark 2.12. It is easy to see that for Proposition 12.101 to hold, one need only 
to assume that (the G-equivariant operator) D E is G-transversally elliptic. 

3. The geometric quantization formula for proper actions 

We now turn back to the situation as in fJTJ In this case, E = A°'*(T*M) (g) L p 
and Q°'*(M, L p ) = T(A°'*(T*M) L p ). 

Let D LF denote the corresponding Spin c -Dirac operator (cf. [TU Section 1]). 
Clearly, D L is G-equivariant. 

Let n°>*{M,L p ) G be the subspace of G-invariant sections of n°>*(M,L p ). It is 
clear that any section in n° : *(M, L P ) G is determined by its restriction to Y , 

Note that since in the general case where G is assumed to be only locally compact, 
there might not be any Adc-invariant metric on q. 

Choose any metric on q* . Let hi, ■ ■ ■ , /idimG be an orthonormal basis of g* . 
Denote by Vi the Killing vector field on X generated by the dual of hi (1 < i < 
dim G) . The point here is that the function 

dimG 

(3.1) n = ||/i|| 2 =Y,rf 

i=l 
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might not be G-invariant, thus the associated Hamiltonian vector field X n might 
not be G-invariant. We first construct an invariant one out of it. 

Recall that the cut-off function c has been defined in 

Let 



(3.2) 



X%= [ c^xfX^dg 
Jg 



denote the averaged G-invariant vector field on M, where X^ 1 denotes the pullback 
of X u by g € G. 
For any T > 0, set 

rzj T 



(3.3) 



D? = D LP 



Then it is G-equi variant. Moreover, it is a formally self-adjoint Dirac type operator 
in the sense of (|2.4[) and thus the results in §2 apply here to Dff . 
From (|3.2p and the fact that 



dimG 



(3.4) 



X u = 2 P*Vi 



(cf. pH (1.19)]), it is clear that at any x € M, X% lies in T x {Gx). Moreover, by 
(fl~T|) and ([33), one verifies that for any s € Q,°>*(M, L*>) G , 



(3.5) 
where 
(3.6) 
and 

(3.7) 



A°-'(T'M)®L" 



H G = 



(A (8) Id L p + 4 P TrV^TH G (x)) s, 
c(g- 1 x) 2 H(g- 1 x)dg 



A 



a°-*(T*M) 
V A-« 



c{g- l xf 



dimG 

; E 

i=l 



Hi(g x)L dg 



is of order zero and does not involve p. 

Let U' be constructed as in §2. Let W be any open neighborhood of /i _1 (0) in 
M. We first show that the following analogue of [16l Theorem 2.1] holds. 

Proposition 3.1. There exists po > 1 such that for any integer p > po, there exist 
C > 0, b > verifying the following property: for any T > 1 and s £ f2 0, *(M, L p ) 
with Supp(s) n W C W \ W , one has 



(3.8) 



PfD^(fs) 



> 



C(\\fs\\l + (T-b)\\fs\\l) 



Moreover, if g* admits an Ada -invariant metric, then one can take po = 1. 
Proof. One computes first that 



(3.9) 



PfD?(fa 



P f [fD!f P s + c(df) S 



> 



Ci\\fs\ 



for some constant C\ > 0. 
On the other hand, one has 



(3.10) 



fD 



L" 



D^{fs)-c(df)s 



> 



C2IIM 



for some constant G2 > 0. 
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From (|3.9p and (|3.10[) . one sees that there exists G3 > such that 



(3.11) 



P f L$ (fs) 



> - 

" 2 



D?(fs) -C 3 \\fs\\l 



Since fs has compact support, one has 



(3.12) 



Dif"(fs) = (D*f(fs),D!f(f S )) = (D^^(fs)Js 



L p 1 



Now since s is G-invariant, from |T6l (1.26)], (|3.3j) . (13.51) and (|3.7p . one computes 
that 



(3.13) D^ 2 (Ja) = D^ J (Ja 



L p ,2, 



dim M 



£ c( ej )c V™I? (/ S ) 



1TX«(/) S +^|X«| 2 (/ S ). 



- V-IT (A <g> Id LP ) (/«) + ijmTHofs - 

Lemma 3.2. One has Uq 1 ^) = H~ X {Q). 

Proof. By the definition (|3.6[) of "Hg, it is clear that for any x £ /i _1 (0), Hg(x) = 

0. 

Conversely, for any x ^ /i~ 1 (0), by (|2.2[) . there exists g £ G such that c(<? -1 a;) 7^ 
0. Thus, c(g~ 1 x)n(g~ 1 x) = c(g~ 1 x)g* n(x) 7^ 0, from which and from Q3.6P one 
gets that Hg(i) 0. Q.E.D. 



By Lemma 
(3.14) 



for any x G U' \ W. 
Clearly, 



(3.15) 



there exists a constant a > such that 
Hq{x) > a 

Re((V=Txg(/) S) / S »=0. 



On the other hand, since / has compact support in V and Supp(s)rW c U'\W, 
it is easy to see that there exists a constant G4 > such that 




dim M 



(3.16) Re J] c ( e ,) c (vi; M ^)(/ s )-V^T(A®Id LP )(/ s ),/ s 



+ 4 P 7T (W G /a, /«) > (4 p7 ra - G 4 ) \\fs\\ 2 . 
From (|3.12l) - (|3.16l) . one sees that there exist constants G5, C§ > such that 
(3.17) 

2 




D^(fs) 



D^'\fs),fs) > C 5 \\fs\\l - C 6 \\fs\\ 2 + (4pna - C 4 )T\\fsf , 



Formula fl3J§ follows from (j3TT1) and (|3~T7)) by taking Po = §± in (|3~T7] . 

For the remaining situation where g* admits an Adc-invariant metric, in this 
case, both H and X H are G-invariant, so we are in an exactly similar situation as 
in [TH1 Section 2]. 
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Set 

dimG 

(3.18) F$ = D^' 2 + ViLvt 

i=l 

as in 16, (1.30)]. 

One verifies directly in this case, in view of (|3.4I) . that 

(3.19) (p^\fs), fa) = (F^(fs)Js) - ^T\T (X n (f)s, fs) . 

Now since / has compact support in U' and Supp(s)nJ7' C U'\W, by proceeding 
in exactly the same way as in [16j Section 2], one sees that there exist constants 
CV, G 8 > such that for any T > 1, 

(3.20) Re ((F$(fa), fs)) > C 7 (\\fs\\l + (T - G 8 ) \\fs\\ 2 ) . 

From (pnT]t . (|3~12|) . ([3TT5]) . ff3TT9|> and f3~20| . one sees that Proposition l3~Tl holds 
for po = 1 in the case where g* admits an Adc-invariant metric. 
The proof of Proposition 13. II is completed. Q.E.D. 

Remark 3.3. Note that in the general case where g* does not admit an Adc- 
invariant metric, Xq might not be the Hamiltonian vector field associated to T~Lg- 
This makes it difficult here to get the pointwise estimates like in [16j Proposition 
2.2] at zeroes of Xq, and partially explains why we need to pass to the uniform 
estimate for p > large. 

Remark 3.4. Proposition 13.11 allows us to localize the proof of Theorem 1 1.1 1 to an 
arbitrarily small open neighborhood of /i -1 (0)nZ7' in V, just as in |16j which relies 
on techniques developed in [TJ. 

Indeed, for any r > 0, let W r denote the G-invariant open neighborhood of 
M _1 (0) in M such that W r = {x e M : H G {x) < r}. 

Since € g* is a regular value of fi and G acts on /x _1 (0) freely, one sees easily 
that when r > is small enough, G also acts on W r freely. 

Lemma 3.5. One has that € R is a non-degenerate critical value of He '■ M — > 
R. 

Proof. Let N be the normal bundle to ^ _1 (0) in M. Let g N be the G-invariant 
metric on N induced by the G-invariant orthogonal decomposition 

(3.21) TM | M -i (0) = Tm _1 (0) ffi N, g™^-Ho) = gT^'io) e g N 

Let p T M _1 (o) ; pN denote the orthogonal projections from TAf| r i (0) to T/x _1 (0) 
and N respectively with respect to (|3.2ip . Let be the connection on N defined 
by W N = P Ar (V™| /i -i( )) where V™ is the (G-invariant) Levi-Civita connection 
associated to g™ . 

For any x G M _1 (0), Z € N x , we identify Z with exp T - M (Z) e M. Since M/G 
is compact, one verifies easily that when e > is small enough, the above map 
induces an identification from N e = {Z £ N : \Z\ < e} to its image in M. 

For any y G /i _1 (0) with c(y) ^ 0, let U v be a small enough open neighborhood 
of y in M^ 1 (0) such that c(y') > Jc(y) > for any y' e and that there exists 
e v > and C y > such that U(y',Z) > C y \Z\ 2 for any Z G iV v / with |y'| < e y . 
Moreover, there is an open neighborhood G y of e in G such that c(g^ 1 y') > \c(y) 
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and 'H(g~ 1 y' , Z) > ^C y \Z\ 2 for any g £ G y and y' £ U y . The existence of U y is 
clear. 

For any x £ // _1 (Q), let h £ G be such that c(h~ 1 x) 7^ 0. Let Uh-i x be the open 
neighborhood of h~ x x constructed above. Then hU^-i^. is an open neighborhood 
of x such that for any x' £ h\Jy l -\ x and Z' £ N x > with \Z'\ < e h -\ xi one has 

(3.22) W G (a/,Z')= / c{g- x hh- x ^fU{g- x x',g*Z')dg 

JG 

(3.23) > ic(fc-Vvol(G fc - la )C h -i 1I! |Z / | 2 . 

By using again the fact that U' is compact, one can cover U' n /i _1 (0) by finite 
open subsets of M verifying (|3.22j) . from which one sees that there exist C > and 
e' > such that for any x £ U' n A^H ) and Z £ N x with |Z| < e', one has 

(3.24) Hg(i,Z) > C|Z| 2 . 

From (|3 . 24[) and the G-invariance of Hq, Lemma T3.5I follows. Q.E.D. 

From Lemma 13.51 one deduces the following key property. 

Lemma 3.6. There exist Sq > and C > such that for any x £ and 
Z £ N x with \Z\ < Eq, one has 

(3.25) \X%(x,Z)\>C\Z\. 
Proof. Recall that for any z £ M, 

(3.26) X%(z) = ( c{ g - l zfX^dg. 

JG 

From (|3~2"6]) and QH (1.14)], one verifies that, 

(3.27) (dH G )*(z)= (d j^c{g- 1 zfH{g- l z)dg 

(3.28) = JX%{z) + 2 f H(g- 1 z)c(g- 1 z) ((g*(dc))(z))* dg. 

JG 

Thus, one has 

(3.29) X%{z) = -J{dU G )*{z) + 2J [ Hig-^Mg^z) ((g* (dc))(z))* dg. 



From J3.24[) . one sees that there exists C > such that when z = (x, Z) is close 
enough to ^ -1 (0), one has 

(3.30) \(dU G y(z)\>C'\Z\. 

On the other hand, since 'H(/z -1 (0)) = and (rfH)| M -i(o) = 0, one verifies easily 
that 

(3.31) A ^H(g- 1 z)c(g~ 1 z)((g*(dc))(z)rd g ^ =Q. 

From (|3.29l) - (|3.31l) . the G-invariance property, as well as the assumption that 
M/G is compact, one gets (j3~25i Q.E.D. 

Formula (|3.25[) is a direct analogue of [111 (3.17)] and [TJ Propo. 8.14]. By this 
and by Proposition 13. 1\ one sees that one can proceed in exactly the same way 
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as in 1, Sections 8 and 9] and |T6j Section 3] to prove that for p > verifying 
Proposition 13. 1[ when T > is large enough, one has 



(3.32) 



ind ( P f D^ T 



hid D 



Indeed, all one need is to modify suitably according to the appearance of the cut-off 
function /. And it is easy to see that this only causes a modification of adding a 
compact operator to the Fredholm operators involved and thus does not alter the 
indices in due course. 

From (|3.32[) . the obvious invariance of the independence of ind(P/-D^ P T ) with 
respect to T (which follows from the Fredholm properties) and Definition 12.41 one 
completes the proof of Theorem ll.il Q.E.D. 



4. VANISHING PROPERTIES OF COKERNELS FOR LARGE p 

We take E = A°>*((T*M) ® JJ>) as in §2 and §3. 
Following Remark 12.61 let 



D^" : H}(Af, A°' cvon ((T*M) <gi L P )) G -> H^(A°< odd ((T*M) <g) L P )) G 



be the operator defined by 

(4-1) ~ +v ,,,-,~ + 

From (gU and ([2"^]) . one verifies that for any s G r(A°< cvcn ((T*M) ® L P )) G , 
(4.2) 5f (/«) = PfD^{fs) - Pf(c(df) S ). 



By (I4.2[) and Proposition one finds 



(4.3) 



ind(Di P ) = ind (P/D^ 



From (j2"J4l and (JUJ), one finds that for any s' G r(A°> odd ((T*M) ® L P )) G , 



(4.4) 



(//) = PfD^ifs') + P f (c(df)s') = /Uf>7 + 2P f (c(df)s') 

= D?(fJ) - c(d/)s' + 2P f {c{df)s'). 
From (|2.6p and (|4.4[) . one finds that there exists C\ > such that 



(4.5) 



(5f )*(/*') 



> 



^- P (/s') o -C 1 ||/.s'|| . 



On the other hand, since £/' has compact closure and / has compact support in 
U', by proceeding in exactly the same way as in [TTJ Section 2], one sees that there 
exist C 2 , C 3 > such that for any s' G T(A^ odd ((T*M) ® L P )) G , 



(4.6) 



^ (/*') > (C 2 p- C 3 ) H/^'llo 



(4.7) 



From (|4. 5[) and (|4.6[) , one sees that when p > 22s. } one has 

(/*' 



D 



L" 



> 



^f-cA\\fs'\\ . 



From (j4.7[) , one sees that when p > max{ , } , one has 
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from which one gets 

(4.9) ker (5+")* = 0. 

From (|4.1[) and (|4. 9[) . one deduces the following result. 
Theorem 4.1. There exists pa>Q such that for any integer p > po, 

(4.10) ind (5+*) = dim (Ker ° . 

Proof of Theorem \1.3\ By the vanishing theorem due to Borthwick-Uribe [2] , 
Braverman \A\ and Ma-Marinescu [11] , one sees that when p > is large enough, 

(4.11) ind (£>+°) = dim (kci ZJ^) • 

From Theorem [Til Definition (gHOt and (JUTTJ), one sees that the first 
equality in (|1.3p holds when p > is large enough. 

By using (|4.6[) , one can proceed as in the proof of (|4.8I) to see that when p > 
large enough, the second equality in (|1.3[) also holds. 

The proof of Theorem II. 31 is completed. Q.E.D. 

Remark 4.2. Formula (|4.9|) and the second equality in (|1.3p might be regarded as 
extensions of the vanishing theorem of the half kernel of Spin c -Dirac operators due 
to Borthwick-Uribe [2], Braverman [4] and Ma-Marinescu [IT] to the noncompact 
case. 

5. Examples and applications 

The main source of examples can be found in the papers of Hochs-Landsman 
[9] and Hochs [3 [8]. In some of their examples, zero is not in the image of the 
moment map. In this case, by Theorem 1 1.3[ for p sufficiently large, we deduce that 
the G-invariant kernel of D 1 ^ and of D^ P both vanish. That is, for p sufficiently 
large, D LP is invertible on the G-invariant sections in this case. 

Another collection of examples, consists of a finitely generated discrete group G 
acting properly on a locally compact symplectic manifold (M,u>) such that M/G is 
compact. In this case, the moment map is trivial, so that the symplectic reduction 
of M is just M/G, which is generally only an orbifold. In the special case when G 
acts freely and properly discontinuously on M, so that M/G is a manifold, then 
Theorem 11.11 is well known and for instance it can be deduced from a result of 
Pierrot [14] . 
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Appendix A. The class [D] 

We consider a locally compact group G which acts properly on a manifold M 
with compact quotient. On M we consider a G-invariant Riemannian metric and a 
G-invariant generalized Dirac operator D which acts on sections of a G-equivariant 
bundle F — > M equipped with a G-equivariant Dirac bundle structure. The G- 
G*-algebra Cb(M) acts on the G-Hilbert space £ :— L 2 (M,F). The Riemannian 
manifold M is complete, and therefore by [4] the operator D is essentially selfadjoint 
on this Hilbert space with domain G C (M, F). We consider the G-invariant operator 
T := D(D 2 + l) -1 / 2 defined by function calculus applied to the unique selfadjoint 
extension of D. The pair (L 2 (M, F), J-) is a G-equivariant Kasparov module (see 
0, 0) over (G (M),C) and represents a class [D] £ KK G {C (M),C). 
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The group 

K G (M) := KK G (C Q (M),C) 
is called the G equivariant if- homology group of M. 

Appendix B. Descent and assembly 

Let C*(G) denote the maximal group C*-algebra. In this subsection we provide 
an explicit description of the Baum-Connes assembly map 

p : K G (M) -> K(C*(G)) . 

Let us first fix some conventions. If A is a G*-algebra with an action p : G — >• 
Aut(A), then we define the convolution product on Cq(G,A) by 

4>*i>{h)= [ <l>{g)p(]9)\<l>(h-*9)\d9 , 

JG 

where dg denotes the left-invariant Haar measure on G. The modular character 
5: G->R* is defined by 

dig- 1 ) = S(g)dg . 
The adjoint * + : A — > A is the anti-involution given by 

4>**{g) := pGOMff- 1 )*] , 

where a n- a* is the anti-involution of A. The C*-algebra G*(G, A) is the maximal 
cross product of G with A and defined as the closure of the convolution algebra 
C C (G,A) with respect to the norm 

\\(j)\\ = SUP ||AC(0)|| , 

K 

where the supremum is taken over all ^-representations n of C C (G, A). The maximal 
group C*-algebra C*(G) = C*(G,C) is obtained in the special case where A := C 
has the trivial action of G. The other important example for the present note is 
the C*-algebra C a (M) with the action (g,f) h-> g*f, g G G, / e C (M). 
There is the descent homomorphism 

j G : A G (Af) = KK G (C (M),C) -> KK(C*(G, C (M)), C*(G)) 

introduced in [BJ 3.11] (we will give the explicit description in the proof of Lemma 
IE.1|I . Following [5, Ch.10] we choose a non- negative cut-off function c € C^°(M) 
such that J G g*c 2 dg = 1. Then we define the projection P e C*(G, Cq(M)) by 

(B.l) P( 5 ) = cg'cSig) 1 ' 2 G C C (M) . 

Since G acts properly on M we observe that P G G C (G, Gq(M)). The relations 
P 2 = P = P* arc straightforward to check, 

P 2 ((/,to)= / c(h-\n)c(m.)8{h) 1/2 c(g- 1 hh- 1 m)c(h- 1 m)8(h- 1 g) 1/2 dh 

JG 

= c{g- 1 m)c(m)S(g) 1/2 = P(g,m), 
P*{g,m) = c( 5 - 1 m)c( 5ff - 1 m)5( 5 - 1 ) 1 /2 ( 5( 9 ) = P{g, m ). 

Let [P] G K (C*(G,C (M)) = M(C, G*(G, G (M))) be the class induced by P, 
which is independent of the choice of c, since any two such functions co,c\ can 
be joined by a path ct := \/ ico + (1 — t)c\ which induces a corresponding path of 
projections. 
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Definition B.l. The assembly map fj, : K G {M) -> K{C*{G)) ^ KK(C,C*{G)) 
is defined as the composition 

A^ G (C (Af),C) C KK(C*(G,C (M),C*(G)) [P] ® C *^°< M »- KK(C,C*{G)) . 

Appendix C. The index 

The non- reduced group C* -algebra of G has the universal property that any 
unitary representation of G extends to a representation of C*(G). In particular, 
the trivial representation of G on C has an extension 1 : C* (G) — > C. On the level 
of if-theory it induces a homomorphism / : K (C* (G)) — > Ko(C) = Z. 

If we identify 

K(C*(G))^KK(C,C*{G)) , 

then the homomorphism / can be written as a Kapsarov product • • • <8>c*(G) 
where [1] £ KK(C*(G),C) is represented by the Kasparov module (C, 0). 

Definition C.l. We define index : K G {M) — > Z to be the composition 

K G (M)4if(C*(G))4z. 

Appendix D. A model 

Let e : G — > C* be a character. By L 2 oc (M, F) G we denote the space of locally 
square integrable sections of F which transform under G with character e, i.e. which 
satisfy 

9*<t> = z{g)4> 

for all g e G. Multiplication by c defines a map c : L 2 oc (Af,F) G ->■ L 2 (M,F). 
This map is actually injective and has a closed range H f C L 2 (M,F). In order 
to see this we define the continuous maps E e : L 2 (M,F) -> Lf oc (M,F) G and 
Q e :L 2 (M,F)^iJ e by 

EM~ I e- 1 (g)g*(c^)dg, Q e (cf>) := cE e ($, 

JG 

= [ e- 1 (h- 1 z)(c(t))(z- 1 l)dz 
Jg 

= e(h)E e (cf>)(l) 
For e Lf oc (M,F) G we have -E e (c0) = </>, since 

E e (c0)(/i) = / e-\g)g*c 2 {h)g*ct>dg 
Jg 

= f g*c 2 (h)^(h)dg 

JG 

= 4>{h). 

This implies injectivity of c, and furthermore Q e (c<p) — c<p. Therefore Q e is a 
projection onto H f which is in fact orthogonal for e = (5 -1 / 2 , the square root of the 



18VARGHESE MATHAI AND WEIPING ZHANG (WITH AN APPENDIX BY ULRICH BUNKE) 



modular character, 

(Q s -V*4>,1>) = {c [ g*{ccj ) )5 1 ' 2 (g)dg^)^ ( {g*{c4>),c^)5 1 / 2 {g)dg 
Jg Jg 

= [ {c^{g- 1 T{c^))8 1 l 2 {g)dgL [ ( c 0, g * (c^))S 1 / 2 (g)dg 
Jg Jg 

= (4>,cf g*{c^)5 1 l 2 {g)dg) = (0,Q,-W) , 
Jg 

where we use for the marked equality that the measure S 1 / 2 (g)dg is invariant with 
respect to inversion g t— > g^ 1 . 

The map c further induces an injective map of Sobolev spaces 

c:Hl oc (M,F)f -+H\M,F) , 

and we let H\ C H 1 (M, F) denote the closed image under c. 
We define the operator D e : H\ — > H e by 

(D.f) D e (cf) = Q e D(cf) . 

Lemma D.l. The operator D e : H\ — > H e is Fredholm. 

Proof. To see this we first choose a G-invariant parametrix R for D which is a 
G-invariant pseudo-differential operator of order — f with finite propagation. This 
operator induces a G-equivariant map R : L 2 oc (M, F) — > H\ oc {M, F), and therefore 

R e : cRE 6 \h : H € — y 

We have 

D e R e = Q e DcRE = Q e cE e + Q e [D, c]RE + Q £ c{DR - l)E e . 

Using that Q e cE e \n t = 1h c , and that [D,c] = c(dc) and c are compactly supported 
operators of order zero, and R and DR ~ 1 arc of order — f we see that D e R e — 1h c 
is compact. In a similar manner we show that R e D e — I#i is compact. □ 

Note that the index of the operator D\ associated to the trivial character is studied 
in the main text by Mathai-Zhang. On the other hand, we will see in Proposition 
ID. 31 that the index of the operator D s -i/ 2 is equal to index([Z?]). The following 
result connects both cases. 

Lemma D.2. We have index(Z?i) = index(Z? d --i/ 2 ). 

Proof. The main idea is that S 1 ^ 2 can be connected with the trivial character by the 
continuous path of characters et := <5~*/ 2 , t G [0, 1]. Let I — [0, 1] and consider the 
G(J)-Hilbert-modules C(I,L 2 (M,F)) and C(7, H 1 (M, F)). The family of opera- 
tors Q tt defines projections Q on C(I, L 2 (M, F)) and G(I, H l {M, F)) with images 
H and H 1 . Furthermore, the family D et induces an operator D : H 1 —> H° whose 
parametrix R is given by the family R et . These data give a Kasparov module 

*)) 

over C{I) which is a homotopy (see [2]) between the Kasparov modules 
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representing index(Di) and index(P 5-1/2). □ 

We can now formulate the main assertion of this note: 
Proposition D.3. We have index([D]) = index(D s -i/2) 

Appendix E. Proof of ID. 31 

We first apply j G to the Kasparov module (L 2 (M, F), F) representing [D]. Note 
that by the universal property of the maximal crossed product the compatible G 
and C (M)-actions on L 2 (M,F) extend to an action of C*(G,C (M)). 

Lemma E.l. j G ([D}) ® C *(G) [1] € KK(C*(G,C (M)),C) is represented by the 
Kasparov module (L 2 (M, F) , J-) . 

Proof. According to [U 3.11], j G {[D]) is represented by {C*{G,L 2 (M,F)),F), 
where C* (G, L 2 (M, F)~) is a right C* (G)-module with a left action by C* (G, G (M)). 
It is a closure of the space of compactly supported continuous functions / : G — > 
L 2 (M,F). The operator f is given by (ff)(g) = {Ff)(g). The G*(G)-valued 
scalar product is given by 

(/l,/2>(<?)= / (h(h)J 2 (hg))dg 

JD 

Furthermore, the left action of G*(G, Go(M)) is given by 

(#)(<?) = / m{hf){g)dh . 

JG 

Using that G* (G, L 2 (M, F)) ® C *(G) C = L 2 (M,F) by 

/ f(g)dgv . 

JG 

Therefore j G ([Z)]) ®c*(G) [1] is represented by the Kasparov module (L 2 (M, i 71 ), J 7 ), 
where the left action of G*(G, G (M)) on L 2 (M, F) is given by 

(E.l) W) = [ ^(h)hfdh . 

JG 

□ 

We now compute [P] <S>c*(g,c (m)) (j G ([D ]) ®c»(G) [I])- We represent [P] by the 
Kasparov module (PG*(G, G (M)), 0). We must understand PG*(G, Go(M))(g)c. o(M) 
L 2 (M,F). The operator Q,5- 1/2 := cE s -i/i is the orthogonal projection L 2 (M, F) — > 
H s -i,2 . If we combine the formula (jEljl for the action of G* (G, C (M)) on L 2 (M, F) 
with the definition (|B.1[) of P we see that the projection P acts as Q s -i/2, and 

PG*(G,G (Af))® c , (G!Co(M)) i 2 (Af,F) - PL 2 (M,F) 
= Q 5 - 1/2 L 2 (M,F) = H 5 - 1/2 

Let L : H s -i /2 — > L 2 {M,F) denote the inclusion. Since Qs-1/2 is othogonal, the 
operator (|D.1I) can be written in the form 



D = L*DL 
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which makes clear that it is self adjoint. We form J 7 := Dg-i/2(l+Dg_ 1/2 Dg-i/2)~ 1 / 2 . 

The Kasparov module (H,T) over (C, C) represents index(Z? 5-1/2) € Z under 
KK°(C, C) = Z. The assertion of Proposition ID . 31 immediately follows from 

Lemma E.2. [P]®c*(G,c (M)) {j G ([D}) <8>c*(G) [1]) * s represented by the Kapsarov 
module (H, J 7 ) . 

Proof. In order to show the claim we employ the characterization of the Kasparov 
product in terms of connections (see [6l 2.10]). In our situation we have only to 
show that T is an ^-connection. 

For Hilbert-C*-modules X, Y over some C*-algebra A let L(X, Y) and K{X, Y) 
denote the spaces of bounded and compact adjoinable yl-linear operators (see [2] for 
definitions). For £ e PC* (G, C (M)) we define (9 5 e L(L?(M, F),H) by 9 ( (f) = £/. 
Since T and T are selfadjoint, we only must show that 

% o T - f o 4 € K(L 2 (M, F), H) . 

We have ^J 7 — J"£ = J 7 ] + {F — P)P£. Since J 7 ] is compact it suffices to 
show that (T- T) P is compact. We consider D := (1 -P)£)(l - P) + LDL* . Then 
by a simple calculation we have D = D + R, where i? is a bounded operator. Let 
T := t>{\ + V' 2 )- 1 ' 2 . Then (F - LFL*)P — (J 7 — P)P. Let c £ C c °°(Af) be such 
that cc = c. Then we have (J- — F)P = (J- — J-)cP. Therefore it suffices to show 
that (J 7 — ~F)c is compact. This can be done using the integral representations for 
J 7 and T as in [3]. 
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